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We present a scenario for the nonequilibrium dynamics in the hmit of smaU entropy production. 
We discuss (i) the appearence of different time-scales, (ii) the modification of the fluctuation- 
dissipation theorem and its relation to effective temperatures and partial equilibrations and (iii) 
the validity of Onsager reciprocity relations. We distinguish these properties by their reaction 
to infinitesimal perturbations. We recall that one can easily change the time dependence of 
observables by applying an infinitesimal force while time-reparametrization invariant features 
remain unchanged under the same perturbations. With the aim of better understanding these 
properties, we consider the effect of several baths with different temperatures and time-scales 
on the dynamics. This is done in two ways: numerically, by using a especially developed Monte 
Carlo algorithm that mimics the coupling to multiple baths; analytically, by computing the 
time-dependent probability density of simple systems in contact with multiple baths. We finally 
argue that these features are related to supersymmetry, the reparametrization invariance of the 
slow dynamics and its spontaneous breaking. This scenario is consistent within any perturbative 
resummation scheme. A brief version of this article appeared in Ref.^' 
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§1. Introduction 

In many dynamical systems, there is a quantity that 
can be naturally interpreted as the entropy produc- 
tion.^' It depends on the time-dependent probability dis- 
tribution and vanishes only when the system reaches 
the Gibbs-Boltzmann (GB) measure. The limit of 
small, though non-vanishing, entropy production (SEP) 
is achieved in a relaxing system at long times, and in sta- 
tionary systems driven by external forces (or by different 
thermal baths) when the external power input tends to 
zero. 

A finite system in which all forces derive from a po- 
tential approaches, for any reasonable dynamics and in 
the long-time limit, the GB distribution. In contrast, an 
extended system might stay far from equilibrium even at 
very long times, producing entropy at a small rate. In 
this SEP limit the probability distribution is not a small 
perturbation around the GB equilibrium one. 

There are several examples of such nonequilibrium sys- 
tems. An infinitely large system with growing domains 
has, at any finite time, properties that are dominated by 
the domain walls^' and is out of equilibrium. Similarly, 
glassy systems 'age': their responses and correlations de- 
pend not only on time-differences but also on the time 
elapsed since their preparation.^"^ Both facts are taken 
into account neither by the GB distribution nor by a sim- 
ple perturbation around it. 

On the other hand, a system that would otherwise age 
might be kept in a stationary yet far from equilibrium 
regime of sustained (relative) youth by pumping a small 
quantity of energy. ^^"^^^ Such thing would happen if do- 
mains are kept on average from growing by small, non- 



conservative forces. While the experimental situation 
for glasses is less clear in this respect, simple models sug- 
gest that if one subjects a system below the glass temper- 
ature to shearing forces, the viscosity may stop growing 
at a large, driving-power dependent value. This situa- 
tion is reminiscent of what happens in granular flow.^^' 
In these cases the systems are explicitly kept far from 
equilibrium by the 'non-potential' forces. 

If the SEP limit is not the GB measure, is there 
any generic, model independent statement we can make 
about it? The purpose of this paper is to discuss several 
aspects of a scenario with partial equilibrations at sepa- 
rate time-scales^' inspired by 'mean-field' glass theory. 
Although we cannot show that this scenario is the most 
general one, we can show that it is consistent in any di- 
mension. It leads to definite predictions, some of which 
have already been tested, and some new ones that, to a 
hmited extent, we test here. 

The discussion will be aimed at extended systems sat- 
isfying reasonable spatial homogeneity properties. We 
may easily construct counterexamples of the present sce- 
nario in models with disconnected or almost discon- 
nected parts, in which microscopic couplings scale with 
the system size, etc. Throughout this paper whenever a 
quantity is declared to be 'small', it must be understood 
with the zero entropy production limit taken first, and 
this itself taken after the infinite size limit. 

§2. Formalism 

Consider a system described by the variables (pi, i = 
1, . . . , TV, that we encode in a vector cj), with energy E[(j)). 
A nonconservative force /, scaled with a parameter 
acts on (p. If the system is set in contact with a white 
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thermal bath, the uncorrelated Gaussian noises r]i have 
zero mean and variance 2roT. Tq is the friction coeffi- 
cient. The equations of motion are 

-rrii^i - + Dfi{$) = To^i - % (2.1) 

and the masses rrii can be zero in particular. 

If the system is coupled to a coloured Gaussian bath,^°) 
the noise and friction terms are 
ft 

dsu{t,s)^i{s)- Pi (2.2) 



with {pi{t)pj{tw)) = T* 5ij v{t,tw) and T* the tempera- 
ture of the bath. The presence of the same kernel v{t, s) 
in the noise-noise correlation and in the friction term is 
a consequence of having taken a bath in equilibrium. 

We define the correlation functions and the linear re- 
sponse of the variable to a kick applied to cjij at : 



Cij{t,tyj) — {(l>i{t)(j)j{tw)) ,Rij{t,tyj) — 



6hj{tw) 



h=0 



Using a standard diagrammatic approach,^^^ one can de- 
rive a set of two coupled dynamic equations for dj [t, tw) 
and Rij{t,tw) for any model. In general though, one 
does not suceed in performing the sum of diagrams in- 
volved. There are two main strategics to obtain a closed 
set of equations. The first consists in using simple mod- 
els, i.e. simple expressions for E{(l)). This is the choice 
made when working with 0(7V)-type models for ferro- 
magnetism,"^) fully-connected spin-glass models,^"' ^^'^^^ 
models in infinite dimensional embedding spaces, ^^'^^^ 
etc. The second consists in choosing a recipe to select a 
subset of the infinite set of diagrams in such a way that 
one can sum them all and express this sum as an explicit 
functional of dj and Rij . This is a route commonly fol- 
lowed in field theory and it is used, for example, to derive 
the mode-coupling theory for super-cooled liquids. 

In fully-connected models all n-point functions can be 
expressed in terms of two-point functions, which then 
provide a complete description of the dynamics. In finite 
dimensional models this cannot be done in closed, exact 
form, and the description in terms of two-point functions 
is not complete. 

For all models, the equations for two-time functions 
have the structure of Schwinger-Dyson equations. Our 
claim is that in the SEP limit their solutions share the 
aspects discussed in Sect. 3. This is a consequence of 
the spontaneous breaking of a large reparametrization 
invariance appearing in the long waiting-time limit. 

We wish to stress that neither the methods used to 
obtain the dynamic equations nor the scenario discussed 
in this paper rely on the presence of quenched disorder. 
This is unnecessary in a dynamic treatment. 

§3. The dynamic scenario 

3. 1 Fast and slow dynamics. Infinite sensitivity of the 
slow dynamics 
Two-time functions have different behaviours in two 
time-regimes separated by a model-dependent character- 
istic time T{tw) that diverges in the SEP limit. The re- 



laxation is fast for t — tyj small with respect to T(t^) and 

it is fast for t — t^,, large with respect to T{tyj), t — tyj > 0. 
The correlation and response are then 

Cij {tj t'ln) — ^ij ^w) ~^ ^ij (^1 l-w) , 

R^,it,t^) ^ R[j{t - t„,) + Rijit.t,,) , 

where and Rf^ are nonnegligible only for small time- 
differences, and Cij and Rij vary very slowly. This sep- 
aration becomes sharper and sharper in the SEP limit. 
In this sense our treatment is asymptotic. 

A very general feature of systems with slow dynamics 
is that the time- dependence of C'ij and Rjj is sensitive 
to vanishingly small changes in the equations of motion. 
The most familiar example is ferromagnetic coarsening 
in which an arbitrary small random field changes the 
growth law^*) from power to log, making the slow part of 
the autocorrelation change from being a function of t^/t 
to being a function of ln(tu,/To)/ ln(i/To). Another ex- 
treme example is the case of mean-field glasses, in which 
weak nonconservative forces completely destroy aging, 
rendering the problem stationary. 

The "infinite sensitivity" is due to the presence of flat 
directions in the free-energy landscape^ ''' and this 
is also the very reason why there is slow dynamics. This 
physical fact has a mathematical counterpart in the in- 
variances of the equations. 

The fact that one can change from aging to stationary 
slow dynamics by applying infinitesimal perturbations is 
indeed the justification for treating both situations on 
the same footing. 

3.2 Fluctuation-dissipation theorem and natural effec- 
tive temperatures: time-scales and thermalisation. 
Quite generally, a weak form of the fluctuation- 
dissipation theorem (FDT) holds in the SEP limit^^^ 



_ odCij{t,tyj) 



e(i-t^)~o. 



(3.1) 



This is cither because both terms arc large and cancel 
leading to the usual FDT or because both are small but 
not necessarily equal, violating FDT. is the inverse 
temperature of the thermal bath, itself in equilibrium. 
A stronger relation holds also in the SEP limit: 

Rij{t,t^) = 0fj'{t,t^)^^^^ Bit - t^) (3.2) 

Otw 

and defines the inverse 'effective temperature'^^' 
P^J^ ■ Equation (3.1) states that one can have effective 
temperatures that are different from 1//3 only for the 
slow degrees of freedom. In what follows we call natu- 
ral effective temperatures the values that T^^^ takes for a 
system in contact with a single bath, as opposed to those 
arising due to more complicated thermal environments. 
The existence of non-trivial effective temperatures is es- 
sentially related to the production of entropy.^^^ 
If we define, as in experiments,^^ 



(Xi,- +iXij){^,tw) 



dre^'^^R.jit^^t^-TXZ.?,) 
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dTe'^^ajit^,t^-T)i3A) 



f3^^^ can be alternatively defined by using^^) 



(3.5) 



Equations (3.2) and (3.5) do not necessarily coincide. 

The scenario discussed in this paper states that for all 
pairs of observables and for each time-scale the effective 
temperatures take a single value. That is, 



,if 



0^2 



(3.6) 
est (3.7) 



in the SEP (old aging or weakly driven) limit. Impor- 
tantly enough, the definitions (3.2) and (3.5) are in this 
limit completely equivalent. [Note, in passing, a pecu- 
liarity of the (important) case of infinite effective tem- 
peratures: all /3's in (3.6) and (3.7) might tend to zero 
but their quotient not be one.] 

It is also important to mention that the value of T^^^ 
can sometimes very slowly change in time, in a much 
slower scale than all other in the problem, as emphasized 
by Nieuwenhuizen.^^' 
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Fig. 1 . M copies of the system coupled to a heat bath at temper- 
ature T and to a thermometer that is, in this sketch, represented 
by an oscillator. 



In order to show that (3^^^ [ioi^t^) is indeed a tem- 
perature measured by a thermometer we proceed as in 
j^g£ 19,36) measure, with a 'thermometer' consist- 

ing of a degree of freedom x with a potential V{x) (see 
Fig. 1), the temperature of an observable vl((/)). In or- 
der to do so, we couple the thermometer linearly to the 
observable A of an ensemble of many (M) independent 
copies of the system, subject to the same history.^^) In 
App. A we show that the equation of motion for x be- 
comes, for large M, 



mx{t) 



dV{x) 
' dx{t) 



■k- 



' / dsRAA{t,s)x{s)+p{t) (3.8) 

J to 



with p a Gaussian noise with zero mean and correlation 
{p{t)p{t^)) =k''CAA{t,t^) . (3.9) 

Caa is the auto-correlation of the observable A at two 

different times and Raa is the response of the same ob- 
servable with respect to an infinitesimal perturbation h 
that acts at time tw modifying the Hamiltonian accord- 
ing to H ^ H — A{tu,)h. If Raa and Caa are linked by a 
time-scale dependent effective temperature that satisfies 
(3.7), we can decompose them as a sum of terms, each 
evolving in a different time-scale. Hence, in the weak 
coupling limit 0, Eq. (3.9) is a Langevin equation 

with several 'baths' of the form (2.2) acting on widely 
separated time-scales and each with its own tempera- 
ture. If x is tuned to respond to a single time-scale, it 
will measure only its temperature. 

A simple way to view the relation of (3^^^ to the zcroth 
law^^) is to connect alternatively x to an observable A 
and an observable B (simultaneously for an ensemble of 
M systems, as in the thermometer case). One shows that 
the average heat flow goes from the observable having a 
lower to the one having a higher P^^^ . 

On the experimental side, Grigcra and Israeloff^®^ gave 
evidence for the existence of non-trivial effective temper- 
atures in glycerol by showing that Nyquist FDT is vio- 
lated below Tg. In the context of spin-glasses, an indirect 
- and not exact - method also suggests that non-trivial 
effective temperatures appear in the glassy phase. 

On the numerical side, the simulations of many groups 
gave evidence for the existence of non-trivial FDT vio- 
lations (and, consequently, effective temperatures) in a 
large variaty of models. Among them we can mention 
models undergoing domain growth,^^-' spin-glasses in fi- 
nite dimensions,^^^ and Lennard-Jones systems.*^' 

3.3 Response to slow, auxiliary baths. Thermalization 
of subsystems. 
If glassy systems have natural effective temperatures 
associated with the slow degrees of freedom, it is then 
natural to ask how would they react to a small coupling 
to an additional slow auxiliary bath of temperature 
The effect of the additional bath is taken into account by 
adding a term like (2.2) to the Langevin equation. The 
simplest choice is v{t.t^) = i'{\t — i^l/r*) with t* the 
characteristic time of the bath and v a smooth decreasing 
function. 

Within this scenario an arbitrarily weak auxiliary bath 
with i/(0) small has an important effect provided it is 
sufficiently slow (r* large), and the temperature T* is 
within the range of effective temperatures of the slow 
dynamics. The (slow) time dependences of all correlation 
and response functions are affected by a time rescaling 
t ^ K{t) such that the time-scale which has a natural 
effective temperature T* is locked to the time-scale r*. 
(This is possible thanks to the sensitivity property.) 

In particular, an aging system with a single T^^f > T 
will become stationary if T* > T^^^, and be hardly af- 
fected if T* < T^^^. More generally, an aging system 
with multiple effective temperatures will become par- 
tially stationary (for all the time-scales with T* > T^^^), 
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but will still have aging for time-scales with T* < T^^^. 

We hence have argued, "'^^ very much in the spirit of 
Refs.'*^"^*-' that the coupling to slow auxiliary baths are 
perturbations 'conjugate to the natural temperatures'. 
The arguments put forward in the previous two para- 
graphs arc supported by simulations of spin-glasses both 
mean-field and 3D (the latter very encouraging). In 
App. C we describe the algorithm used to simulate a 
spin system in contact with a multiple bath. 

Another relevant question is mutual thermalisation be- 
tween two subsystems having different natural effective 
temperatures, but sharing the same bath.^^' This is re- 
lated to the response to an auxiliary slow bath, since, to 
a certain extent, each system acts as an auxiliary bath 
for the other when plac;cd in mutual contact. 

Within the present scenario two situations are pos- 
sible:"'^) strong coupling, in which the effective temper- 
atures equalise; and weak coupling, in which the com- 
bined system preserves essentially the temperatures of 
its constituents, but rearranges them in widely separated 
time-scales. In the latter case, the combined system has 
three temperatures, the bath temperature for the fast 
processes, the lowest and highest original effective tem- 
peratures for the intermediate and slowest timescales, 
respectively. 

3.4 Reciprocity relations. 

An unexpected feature that appears in this scenario 
are the reciprocity (Onsager) relations:^-* 



{A{t)B{t^)) = {B{t)A{t^)) . 



(3.10) 



If this equality holds for the observablcs A and B, 
Eqs. (3.6) and (3.7) imply a similar relation for the re- 
sponses. There is no reason a priori why the reciprocity 
relations should hold in a situation in which FDT is 
strongly violated. This is all the more surprising in an 
aging case in which the system is not even stationary. 
The interest of these relations is that they are relatively 
easy to measure in a simulation (results for 3DEA ap- 
peared in Ref.^)) or in an experiment. The reciprocity 
relations are intimately related to the partial equilibra- 
tions. . 

§4. Multiply thermalized systems 

A standard procedure in the dynamics of extended sys- 
tems is to keep some macroscopic variables of interest 
and integrate away the others. The eliminated variables 
become part of a 'thermal' bath. 

In equilibrium, the validity of FDT and of time- 
translational invariance (TTI) ensure that the friction 
and noise terms, coming from the projected sector, sat- 
isfy FDT (of the second kind). The whole procedure 
is self-consistent since the variables evolving in contact 
with a bath satisfying FDT will eventually satisfy FDT, 
now called of the first kind.^^ 

In an out of equilibrium situation FDT (and sometimes 
TTI) do not hold. How can we then picture the effect of 
the projected variables on our chosen ones? 

We treat a system in contact with a multiple bath with 
different temperatures and time-scales that is based on 



subsequent adiabatic approximations of the slower baths. 

This approach has points in common with the 'pin- 
ning field' approach of Kirkpatrick and Thirumalai^^-' 
and Monasson'*'') and with recent developments of Al- 
lahverdyan et al.^^^ and Franz and Virasoro^^^ We claim 
that, in the SEP limit, correlation and response func- 
tions of the selected macroscopic variables behave as if 
they were subject to such a multiple bath. 

By studying in detail the evolution of a harmonic os- 
cillator in contact with a multiple bath, we show how, 
even in this very simple model, different effective temper- 
atures are induced by the coupling to several baths. 

4.1 The construction 

Consider a particle of coordinate x moving in a po- 
tential V{x) under the influence of two thermal baths: a 
fast white bath of temperature T and friction coefficient 
Fo, and a slow bath of temperature T*, characteristic 
time-scale t* and strength Fi. Note that such a system 
has a non-Gibbsean stationary measure. We are inter- 
ested in the evolution of the particle taking r* large with 
respect to any other characteristic time. (The following 
argument can be easily extended to any number of vari- 
ables Xi, i — I, . . . , N.) This problem, and its solution, 
is very similar to the one studied By AUahverdyan and 
Nieuwenhuizen in the second article of These authors 
analysed two interacting variables that are respectively 
coupled to two baths with different temperatures and 
very different time-scales. 

Neglecting the effect of inertia one has 



Tox{t) + 



* dV 

ds v{t - s)x{s) = + V{t) + pit) 



where 77 and p are the Gaussian thermal noises of the fast 
and slow baths, respectively, both with zero mean and 
variances {r/{t)ri{tw)) — 2TTod{t — t^^) and {p{t)p{tw)) = 
T*v{\t-ty,\/T*). We assume that i>(0) = Fi and £^(0+) = 

0. We have set the system in contact with the slow bath 
at the initial time t^ = —00. If we integrate by parts, 

rox{t) = -^-T,x{t)+v{t) + h{t) (4.1) 

h{t) = - I ds i){t - s)x{s) + p{t) . (4.2) 

In the adiabatic limit, the slow bath generates a quasi- 
static field h{t). (Indeed, using i>(0+) = and r* ^ 

1, one shows h = 0(l/r*) <C 1.) Hence, x has a fast 
evolution given by Eq. (4.1) with h fixed and it achieves 
a distribution 



P{x/h) 



-l3{v{x)+T-,^-hx) 



J dx e 



-p[v{x)+ri^-hx) 



(4.3) 



The denominator defines Z{h) and F{h) = In Z{h). 

Henceforth we denote P{a/b) the conditional probability 
of a given b at stationarity. 

The approximate evolution of h is given by Eq. (4.2) 
with the replacement of x in the friction term by its 
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average with respect to the fast evolution: 

dF{h) 



f ( 
h{t) = / dsv{t- s)- 

J — OO 



dh 



-{s)+p{t) . 



(4.4) 



This equation is a non-Markovian and it has all the prop- 
erties of a system coupled to a (slow) bath of temperature 
T*. In particular, the stationary distribution is 



P{h) = 



-0''(F{h) + ^) 



(4.5) 



Reciprocity and FDT for functions of h also hold at sta- 
tionarity. The stationary distribution of x now reads 



>w = / 



dhP{x/h)P{h) . 



(4.6) 



Wo prove these properties in App. B. In particular, if 
T = T* we recover the usual GB distribution for P{x) 
regardless of the details of the slow bath. 

Note that the distribution function P{x) contains the 
superposition of different time-scales and is not a very 
eloquent quantity. 

A case of great interest is the one of a slow bath that 
is not itself stationary, but ages. Suppose that we have 



v{t,s)=u{L{s)/L{t)) 



t> s 



(4.7) 



for some monotonically increasing function L. For the 

fast motion, at large enough times, we recover Eq. (4.3) 
while Eq. (4.2) follows from the change of variables 



(4.8) 



The integrated form of FDT for two observables A and B 
can be obtained by multiplying by B{x) and integrating 

over X. 

ii. E t — tyj is such that h{t) — /i(i^) ^ 0, while the 
field conjugate to A is on, h evolves with Eq. (4.4) and 

F^ih) = -^InJ rf^'e-/5(nx')-^^.A(.')+r.4^-^x') 

= F{h) - HAA{h) , (4.11) 

with A{h) = / dx'P{x' /h)A{x'). If Ha is turned off at 
tw, P{x/h), is first modified in a short time-scale with 
respect to that of h. Then, h continues to evolve but with 
a modified effective potential F{h). Now, FDT holds for 
the evolution of h at temperature T* 



6P{h,t) 



(sec App. B) and 
SP{x,t) 



(3* j dh' P{h,t/h',ty,)A{h')P{h') , 
5P{h, t) 



= (3* j dh dh' P{x/h)P{h, t/h', t^)A{h')P{h') . 
Xising P{h')A{h') = J dx'P{x')P{h' /x')A{x') we obtain 
6P{x,t) f dx' P{x,t/x',t^)A{x')P{x') . 



In these new time-like variables, the rest of the derivation 
can be carried through identically. 'Stationary' means in 
this case invariant with respect to L ^ A x L that leads 
to T — + T-t-ln A in time-like variables (A is a parameter). 

4..2 Reciprocity and FDT 

In its strongest form, reciprocity means that the joint 
probability of having x at time t and x' at tw is equal at 
stationarity^'^^ to the probability of having x' at time t 
and X at tw To prove that this indeed happens, we use 
the separation of time-scales and consider two cases: 

i. li t — t^ is small, h is approximately fixed and we 
have an equilibrium problem at temperature T, with a 
fixed field h. Reciprocity holds in the usual way. 

ii. Ut — tyj is such that h{t) — h{tw) ^ 0, we have 

P{x,t;x',t^) = j dhdh'P{x/h)P{h,t/h',tyj)P{h'/x')P{x') 

Since P{h, t; h', t^) — P{h', t; h, t^) (sec App. B), 

Pix,t;x',t^) = P{x',t;x,t^) . (4.9) 

In a similar way one shows that FDT holds separately 
for each timescale with its own temperature. 

i. li t — t^ is small FDT holds for each h. Denot- 
ing SP{x,t)/6HA{tw) the variation of the distribution at 
time t due to a field conjugate to A that has been on 
from — OO to tu,, we have 

5Pix,t) 



SHA{t^) 

For separate times FDT holds with temperature T* . 

4-3 The effect of a weak coloured bath 

The simplest example where to check the ideas de- 
scribed in Sect. 4.1 and 4.2 is a harmonic oscillator in 
contact with a white and a coloured bath with exponen- 
tial correlation. This problem can be tackled using a 
variety of techniques. 

From the exact asymptotic solution wc; extract the be- 
haviour of the integrated response x{t) = dr' R{t') 
vs. C(t) and read T'^^^ from it. In Fig. 2 we show 
X(C) for T = 0.5, Fo = 1, T* = 1. In the plot above, 
(w + Ti)t* = 2000 > Fo = 1, with lo the frequency of 
the oscillator. The evolution takes place in two time- 
scales (or correlation-scales) characterised by tempera- 
tures T and T*. The straight lines have slopes — 1/T 
and —1/T* showing that there are two temperatures as- 
sociated to the motion of the particle: a fast motion 
for q < C < Qd controlled by T and a slow motion for 
< C < q that is instead controlled by T*. In the plot 
below {lj + Ti)t* = 2 = 0(Fo = 1), the time-scales (or 
correlation-scales) are not well separated, and x(C') con- 
tinuously interpolates between a region of slope of —1/T 
and a region of slope of —1/T*. 

This problem can be alternatively analysed using the 
technique described in Sect. 4.1. One recovers, as ex- 
pected, the exact results of the previous paragraphs. 



5HA{t^) 



j dx' P{x,t/x',tyj)A{x')P{x') . (4.10) 



4-4 Many scales 

The construction of Sect. 4.1 can be generalised to 
many nested scales. Let us see how this is done for three 
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stationary distribution: 




0.3 0.4 0.5 0.6 0.7 



Fig. 2. The x{C) plot for a harmonic oscillator subject to a white 

bath of temperature T = 0.5 and a coloured noise of temperature 
T* = 1. Above: (ui + V-i)t* = 2000 > Tq = 1. The straight 
lines (dots) have inverse slopes — 1/T = —2 and — l/T* = —1. 
Below; (u) + Ti)t* = 2 = O(ro = 1). 



baths; the equation of motion is 



Tox{t)+ f ds {flit - s) + i'2{t - s)) x{s) 

J —OO 

+V{t) + pi{t) + P2{t) 



dV{x) 
' dx{t) 

(4.12) 



with px and p2 two Gaussian thermal noises with zero 

mean, {pi{t)pi{U)) = rj*£>i(|t-tt„|/Tj-), {p2{t) P2{tw)) = 
Tii>2{\t - tw\/T2) and 1 <C <C r|. Proceeding as 
before, we write 

dV(x) 

Toxit) = + (ri + Ta) x{t) + v{t) + hi{t) + h2{t) 

with hi{t) = — ds i'i{t — s)x{s) + Pi{t), i = 1,2, and 
yi{Q)=T„ z>,(0+)°^ 0, ^ = 1,2. 

In the fastest evolution x achieves distribution, 

-0{y{x) + (Ti+T2)4--(hi+h2)x) 

P{x/h,,h2) = , (4.13) 

with Zhi,h2 ensuring J dx P{x/hi,h2) = 1- The evolu- 
tion of hi is obtained by taking /12 to be adiabatic 

hx{t)= f dsux{t-s)^^^^^^-^{s) + px{t) (4.14) 

withe-'3*^i('*i+^=^) = Jdx e-^(^(^)+(ri+r2)4-(''i+''2)x) 
yielding a stationary distribution for hi 



P{h\/h2) oc exp 



-l3l[Fi{hi+h2) 



2rl 



. (4.15) 



Finally, /12 evolves at inverse temperature /3| and has a 



P(/i2) OC exp 



-/?2(^2(M + ^ 



-/3r(^i 



{hi+h2)+- 



(4.16) 



One can 



with e-''2*^'2(/»2) = Jdhie 
also consider two slow baths that are non-stationary. In 
order to have two well separated time-scales, we need 
two (increasing) scaling functions Li{t), L2{t) with 



lim {dt\nL2{t)/dt\TiLi{t)) 

t^OO 







(4.17) 



and, for example, 
iyi{t,s) = i){Li{s)/Li{t)) ,P2{t,s) 



HL2{s)IL2{t)) 



t > s. After performing two transformations like the ones 
in Eq. (4.8), the rest of the derivation can be repeated. 

For this example one concludes that the 'probability 
cloud' of each scale acts as a configuration for the slower 
scale — moving in an effective potential. 

§5. Conclusions 

In the last years great progress has been made in un- 
derstanding the asymptotic nonequilibrium evolution of 
systems with slow dynamics. Much of these develop- 
ments came from the study of simplified models that 
include classical glassy disordered and non-disordered 
models, quantum disordered systems and, importantly 
enough, systems that are constantly driven out of equi- 
librium by external forces. The results collected from 
the solution of several of these cases made apparent the 
existence of various general features. In this article (as 
well as in Ref.-^^) we stressed which arc the features that 
we believe build a scenario for the slow dynamics in the 
limit of small entropy production. Properties iriv dis- 
cussed in Sect. 3. can be quite surprising, in particular 
the latter. In addition, in view of the infinite sensitiv- 
ity of the slow time dependence of the correlation and 
response functions, it is a non-trivial fact that proper- 
ties iiriv are preserved under small perturbations. In 
Ref.^^ we justified this fact by studying the invariances 
(and breakdown of) the dynamic equations in the SEP 
limit.54) 

In short, the image we have in mind is better grasped 
by comparing the general case to the simple problem 
studied in Sect. 4. The Langevin equation for a variable 
x including a non-local friction kernel and a correlated 
noise, Eq. (4.1), is reminiscent of the equation for a sin- 
gle effective variable that one obtains in fully connected 
models, large dimension approximations, etc.^^'^^^ In- 
deed, in the large limit, one can derive such an equa- 
tion by performing a saddle-point approximation of the 
dynamic generating functional. For any dynamic vari- 
able (pi, the 'single- variable equation' reads 

ToMt) = -nit)Mt)+ f (isS(t,s) Ms)+p,it) + r^^it) . 

J to 

(5.1) 

There are two noise sources in this equation: rjiit) 
is the original white noise while pi{t) is an effective 
(Gaussian) noise with zero mean and correlations self- 
consistently given by {pi{t)pj{tw)) = 5ijT*D{t,tyj). The 
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vertex D{t,tw) plays the role of the coloured noise cor- 
relation in a usual Langevin equation. The self-energy 
E(t,t^) appears here as an 'integrated friction'. 

In the case of a system in contact with an external 
coloured bath, the correlation of the noise T*v{t,t^) is 
simply related to the retarded friction v{t,ty,). This is 
the statement of FDT applies for the bath. In the case 
of the single-variable equation for a more complicated 
model, the friction kernel im) and the correlation 
of the coloured noise T*D{t,tw) are properties of the 
system and are not necessarily r(4at(xi in a simple man- 
ner. In the SEP limit, they get related by a modification 
of FDT with time-scale dependent effective temperature 

One then concludes that the structure of these two 
problems is indeed very similar: 

• If one weakly couples a simple system to a slow bath 
of temperature T*, at sufBciently slow time scales 
the system acquires the temperature T* . 

• Glassy systems arrange their internal degrees of free- 
dom in such a way that slow degrees of freedom se- 
lect their own effective temperatures. 

Implicit in the construction presented in Section 4.1 
is the fact that all observables have the same effective 
temperatures at the same two-times. Also implicit are 
the reciprocity relations. These are important in that 
they are potentially measurable, and quite unexpected 
out of equilibrium. 

Appendix A: Measurements of natural effective 
temperatures 

We here recall the definition of a time-scale depen- 
dent effective temperature, for systems out of equilib- 
rium, given in Ref.^^^ The presentation follows closely 
this reference but it makes some points of the derivation 
more precise. 

Let us consider M non-interacting copies of the sys- 
tem,^^) and couple each of them to a simple system 
that acts as a thermometer in the manner sketched in 
Fig. 1. For simplicity, we describe this thermometer with 
a single variable x and each system with a variable (j)a, 
a = 1, . . . , M. The total energy of the complex is 



Etot = m— + V{x) 



M 



a=l 



MV2 

a=l 



where V{x) and E{(j)a) are the potential energies of the 
isolated thermometer and each isolated system. For each 
copy the last term yields an infinitesimal (for M large) 
perturbation corresponding to a field kx/^fM conjugate 
to the observable A{(j)'^). The equation of motion for x 
is 



mx{t) = — 



dVjx) 
dx{t) 



M 

k X ^ 

a=l 



A(</,«)(i) . (A-1) 



For simplicity we choose an operator A such that 
(A(0"))fe=o = where (•) represents either an average 
over different histories of the same system or an average 
over different systems, e.g. (/) = l/M^^^ fa- (If the 
average of the operator A does not vanish, one has to 



work with the difference between the operator and its 
average.) The subindex k = Q indicates that the aver- 
age is taken in the absence of the external field kx/M^/'^ . 
Whenever we take the average in the presence of the field 
we shall denote it 

Assuming that linear response holds for each system, 
the total variation of the average {A{(jf))k caused by a 
field that has been applied from t = Q upto t reads 



5{A{r))k{t) = (A(r))fc(i) - (A(</,«))fe=o(t) = 



Jo 



k 



'M 



-.x[s) 



(A-2) 



where Ra^ {t^ s) is the linear response of the ob- 
servable j4 ((/)") at time t to a change in energy 
—k/^/MxA{(f>") at time s. These thermal history- 
averaged responses are equal for all systems, we hence- 
forth denote them R{t,s) for all a. (We also simplify the 
notation by eliminating the subindex A that identifies 
the observable.) Adding the last equation over a and 
multiplying by k/VM we have 



^ f2{A{r))k{t) =k' f dsR{t,s)x{s) . (A-S) 
VM Jo 

Adding and subtracting from the rhs of Eq. (A-1) the 
average (A-3), we recast it as 

f ds R{t, s)x{s) + p{t) (A-4) 
Jo 



mx{t) 
with 



dV{x) 
' dx{t) 



k ^ 



M 

CK— 1 

The 'force' p{t) is the sum of M independent identically 
distributed random variables. For large M it becomes a 
Gaussian variable with zero mean and variance: 



{p{t)p{tw))k 



A-2 ^ 

— \^ r' 



a,/3=l 



With cijr{i^t^)\k^ = mrm - 

x{A{(f^){tw) — {A{(j)^)}k(tw)))k the connected correla- 
tion in the presence of the field. Up to leading order in 
k 



(A-7) 



The connected correlation can also be substituted by 
the usual correlation since A{(l)°'){t) = 0{1) implies 
(A(r)(t))fc = 0(1/VM). Thus 



\k=0 



Capij-i tw)\ 



k=0 



Sc.pC{t,t^) (A-8) 



since the bare systems are completely independent. Fi- 
nally, 



{pit)p{t^))k = k^C{t,t^) 



(A-9) 



Thus the dynamic equation governing the evolution of 
the thermometer reads 

mx{t) 



dV{x) 



dx{t) 



+ p{t) + k^ [ dsR{t,s)x{s) 
Jo 
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{p{t)p{t^))k = k^C{t,tn,) . (A-10) 

If the response and the correlation of the system are re- 
lated through the FDT relation 

1 dC{t, s) 



R{t, s) 



-e(i-s) . 



(A-11) 



T ds 

one integrates by parts the last term on the rhs of 
Eq. (A-10) and obtains 

dV rt 



mx{t) 



dx{t) 



pit) - TF 



dsC{t, s)x{s) 



+- {C{t, t)x{t) - C{t, 0)x{0)) . (A-12) 

that in the limit of weak coupling, fc^ — > 0, becomes a 

Langcvin equation since the last term can be neglected. 

From this equation we can conclude that the ther- 
mometer, being a system with fast dynamics, will eventu- 
ally equilibrate at the temperature that relates response 
and correlation of the system, Eq. (A-11). The system 
acts as a thermal bath on the thermometer. 

We can also derive this result by choosing a harmonic 
oscillator as a thermometer.-^^) Using V{x) = mu!lx^/2, 
one easily shows that the averaged potential energy of the 
thermometer over a time-window around the measuring 
time tw is 



(A-13) 



with LUo is the probing frequency of the oscillator and 
m = 1. In the large tyj limit, it reaches the following 
limit 



(-E-osc)* 



UoC{u)o, tui) 



(A-14) 



with C and x" defined in Eqs. (3.3) and (3.4). If equipar- 
tition holds for the oscillator, one has 



T^^^{uJo, t^ 



LOoCilOo, ty 



(A-15) 



X"{iOo,tw) 

i.e. the definition given in Eq. (3.5). 

Under the assumption (3.6) we can decompose the cor- 
relations and responses as follows: 

C{t, i,„) = C^{t, t^) + [t, t^) + C^{t, t^) + ... 

-R(i) tw) = R^{t, tyj) + R^{t, tyj) + R^{t, tyj) + ... 



with 



R%t^) = (r^^^^^e{t-t^), (A-16) 

i = 0,1, . . ., i = corresponding to the FDT scale. Then, 
Eqs. (3.9) and (A-12) corresponds to a system coupled 
to a series of baths of inverse temperatures /3^, /3^, 
acting on widely separated scales. The probing frequency 
of the thermometer can be selected to measure any of the 
values of the effective temperature. "'^^ 

Actually, the effective temperature T^^^ in Eq. (A-15) 
might depend on the observable A considered. The pic- 
ture in this paper describes the way in which we think 
these dependences arrange in a physical system. 



Appendix B: Stationary distribution of the 
quasi-static field 

We show that Eq. (4.4) leads to Eq. (4.5) and that 
at stationarity reciprocity and FDT hold. The Fourier 
transform of Eq. (4.4) reads 

h{uj) = r{co)^{u;)+p{uj), (B-1) 
{p{lu)p{uj')) = T*v{uj)2'k5{uj + uj') , (B-2) 

where r(w) = J^^dr exp{iLJT)i>{T)6{T) is the slow bath's 
response function. It is then analytical in the upper half 
complex plane and satisfies, for real uj,^^^ '''*{lu) = r(— w). 
FDT holds for the bath: r{uj) — r{—Lu) = —iujv{uj). In 
order to prove Eq. (4.5), we introduce a set of auxiliary 
variables yj satisfying the ordinary Langevin equation: 



dF 



9yj 



(B-3) 

with (Ci(i)Cj (*«,)) = 2T*TjSij6(t - i^). The aim is to 
show that Y^j^jUj' satisfies the same equations as h, 
Eqs. (B-1) and (B-2).^^) The introduction of j/j allows 
us to convert the original non-Markovian problem into 
a Markovian one. If F is such that Eq. (B-3) drives the 
ensemble yi to equilibrium. 



-r(^+F(E,^...)) 



P{y) oc e 
In Fourier space, Eq. (B-3) reads 



(B-4) 



9yj 

where u)^ arc the roots of —m.jLU^ ^ - 
Defining h{Lo) = ^ ■ Ajyj{uj) one has 



ioj^Tj + Qj = 0. 



E 



mj{u> -w^){u> -u;]-) ' 



(B-5) 



bmce Im(cjj^) < 0, we can choose the variables yj and 
the parameters nij , Tj , flj in such a way to identify 



riu:) = J2 



(B-6) 



Furthermore, we associate the first term in the rhs of 
Eq. (B-5) to the coloured noise p{ui) and we use Eq. (B-3) 
to obtain the noise-noise correlation: 



{p{oj)p{oj')) = 2T*6{uj + oj') 



r,4 



m'j{LJ - u)j'){u) - u)j ){u; + u)j'){lj + uij ) 



(B-7) 



The properties of the poles (i-^f)* 



= —i^f and mj{ujj' + 
^J) = -i^j yield FDT i.(a;) = -^[r(w) - r(-w)]. 
We need an expression for Fi = u{t = 0) = 
duj/{2T:) uiu)). Completing the integration over the 
upper or the lower half plane, we have 



(B-8) 
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We have shown that Eq. (4.4) is equivalent to an or- 
dinary Markovian equation for y, provided one identifies 
h = ^AjUj. The stationary distribution for the yj is 
then given by Eq. (B-4) P{h) is calculated by introduc- 
ing a delta-function: 



OC 



oc e 



(B-9) 



The reciprocity property is immediate from the fact 
that, for a Markovian Langcvin process in equilibrium, 



P{y, t; if, tw) = Pi-if, t; y, t^) 



(B-10) 



Similarly FDT follows from the fact that because it holds 
for any two functions of the j/j, it holds in particular for 
any two functions of h. 

Appendix C: A Montecarlo algorithm with sev- 
eral baths 

We describe the algorithm used to simulate the evolu- 
tion of a system interacting with several thermal baths 
of different type. Let us consider a dynamic spin s = ±1 
with energy E[s) that is in contact with a 'fast' bath of 
inverse temperature /? and a 'slow' bath of inverse tem- 
perature 3* and time-scale t*. The generalization to 
several variables and many baths is straightforward. 

The algorithm is as follows. 

i With probability 1/t* wc generate a Gaussian ran- 
dom variable h with s-dcpendent mean and variance: 



{h) = P*Tls 



(C-1) 



Pi is the strength of the bath. 

ii With probability 1 — 1/r* we make ordinary Mon- 
tecarlo updates of s at temperature 1/(3, with an energy 
-E'tot = Eis) — hs. 

We justify this algorithm as follows. We model the 
slow bath by a system of M non-interacting spins aa = 
±1, a = 1, . . . ,J\f, weakly coupled to s. The total energy 
of system and bath is given by 



Err 



E{s) 



r 



TJ2^Y^^a = E{s)-hs 



(C-2) 



with E{s) the energy of the free spin, Fi the coupling 
constant and the 'field' h defined as ft- = Fi/A/"^/^ '^o-- 
We propose the following dynamics to the coupled sys- 
tem: 

i Frequent updates of s keeping aa fixed. The spin is 
then in presence of a constant external field h. These up- 
dates are done with any Montecarlo procedure, at inverse 
temperature /?. 

ii Unfrequent updates of all da, i.e. of the field h, 
keeping s fixed. This evolution is controlled by an inverse 
temperature j3* . 

If the sequence is long, one can assiime that each Ga 
is in thermal equilibrium, at temperature with an 
energy E{aa) ~ — Fi/TV^/^scto. Each configuration cja = 



±1 has probabilities p+ and p- given by: 

77^ 



P± 



exp(±/J*-^s) 



2cosh(/3*^s) ■ 



(C-3) 



The aa are then identically distributed independent ran- 
dom variables. It follows that, in the limit of large Af, 
/i is a Gaussian random variable. Its mean and variance 
are given by: 



{h} 



As a check of the consistency of this proceedure we 
examine if detailed balance holds, as expected, in the 
particular case of a variable coupled to two baths with 
equal temperatures j3 = j3* . The transition probability 
per unit time to go from the state sa to the state ss is 



P{A -^B) = 



/ 



dh e ^1 Ph{A B) 



(C-4) 

where Ph{A B) is the transition probability given h. 
We assume that Ph{A — > B) satisfies detailed balance 

Ph{B-.A)-' ^^^> 

and we then prove that this implies that the transition 
probability over a time interval r, P{A — > B,t), does 
too. Inserting Eq. (C-5) into Eq. (C-4) we have: 



P{A B) 



dhe ^1 PhiB^A) 



xe 



-l3{V{sB)-V(sA)-h(sB-SA)) 



= g-0{V{sB)-V{sA)) 

i.e. detailed balance. 



P{B A) 



(C-6) 
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